Using connectomics for predictive assessment of brain parcellations

The organization of the human brain remains elusive, yet is of great importance to the mechanisms of integrative brain function. At the macroscale, its structural and functional interpretation is conventionally assessed at the level of cortical units. However, the definition and validation of such cortical parcellations are problematic due to the absence of a true gold standard. We propose a framework for quantitative evaluation of brain parcellations via statistical prediction of connectomics data. Specifically, we evaluate the extent in which the network representation at the level of cortical units (defined as parcels) accounts for high-resolution brain connectivity. Herein, we assess the pertinence and comparative ranking of ten existing parcellation atlases to account for functional (FC) and structural connectivity (SC) data based on data from the Human Connectome Project (HCP), and compare them to data-driven as well as spatially-homogeneous geometric parcellations including geodesic parcellations with similar size distributions as the atlases. We find substantial discrepancy in parcellation structures that well characterize FC and SC and differences in what well represents an individual’s functional connectome when compared against the FC structure that is preserved across individuals. Surprisingly, simple spatial homogenous parcellations generally provide good representations of both FC and SC, but are inferior when their within-parcellation distribution of individual parcel sizes is matched to that of a valid atlas. This suggests that the choice of fine grained and coarse representations used by existing atlases are important. However, we find that resolution is more critical than the exact border location of parcels

Validation of structural brain connectivity networks:The impact of scanning parameters

Evaluation of the structural connectivity (SC) of the brain based on tractography has mainly focused on the choice of diffusion model, tractography algorithm, and their respective parameter settings. Here, we systematically validate SC derived from a post mortem monkey brain, while varying key acquisition parameters such as the b-value, gradient angular resolution and image resolution. As gold standard we use the connectivity matrix obtained invasively with histological tracers by Markov et al. (2014). As performance metric, we use cross entropy as a measure that enables comparison of the relative tracer labeled neuron counts to the streamline counts from tractography. We find that high angular resolution and high signal-to-noise ratio are important to estimate SC, and that SC derived from low image resolution (1.03 mm3) are in better agreement with the tracer network, than those derived from high image resolution (0.53 mm3) or at an even lower image resolution (2.03 mm3). In contradiction, sensitivity and specificity analyses suggest that if the angular resolution is sufficient, the balanced compromise in which sensitivity and specificity are identical remains 60–64% regardless of the other scanning parameters. Interestingly, the tracer graph is assumed to be the gold standard but by thresholding, the balanced compromise increases to 70–75%. Hence, by using performance metrics based on binarized tracer graphs, one risks losing important information, changing the performance of SC graphs derived by tractography and their dependence of different scanning parameters. Previous article in issu

On the intrahemispheric connectivity of the monkey: a diffusion tractography and tract tracing analysis

In this work, we compare diffusion tractography with neuronal retrograde tract tracing of the frontal, cingulate and parietal areas of the monkey. In this work, we compare diffusion tractography with neuronal retrograde tract tracing of the frontal, cingulate and parietal areas of the monkey. We analyze the agreements between the tractography and the tracing for connected and not connected regions. We report an accuracy of 0.71across all pairs of regions, with twice the number of true positive than false positive connections. Some regions show accuracy higher than 0.80, while other regions show accuracy lower than 0.6. A further analysis of the location of false positive and false negative connections will help understand the limitations and improve diffusion tractography algorithms. We analyze the agreements between the tractography and the tracing for connected and not connected regions. We report an accuracy of 0.71 across all pairs of regions, with twice the number of true positive than false positive connections. Some regions show accuracy higher than 0.80, while other regions show accuracy lower than 0.6. Further analysis of the location of false positive and false negative connections will help understand the limitations and improve diffusion tractography algorithms

On the cortical connectivity in the macaque brain:A comparison of diffusion tractography and histological tracing data

Diffusion-weighted magnetic resonance imaging (DW-MRI) tractography is a non-invasive tool to probe neural connections and the structure of the white matter. It has been applied successfully in studies of neurological disorders and normal connectivity. Recent work has revealed that tractography produces a high incidence of false-positive connections, often from “bottleneck” white matter configurations. The rich literature in histological connectivity analysis studies in the macaque monkey enables quantitative evaluation of the performance of tractography algorithms. In this study, we use the intricate connections of frontal, cingulate, and parietal areas, well established by the anatomical literature, to derive a symmetrical histological connectivity matrix composed of 59 cortical areas. We evaluate the performance of fifteen diffusion tractography algorithms, including global, deterministic, and probabilistic state-of-the-art methods for the connectivity predictions of 1711 distinct pairs of areas, among which 680 are reported connected by the literature. The diffusion connectivity analysis was performed on a different ex-vivo macaque brain, acquired using multi-shell DW-MRI protocol, at high spatial and angular resolutions. Across all tested algorithms, the true-positive and true-negative connections were dominant over false-positive and false-negative connections, respectively. Moreover, three-quarters of streamlines had endpoints location in agreement with histological data, on average. Furthermore, probabilistic streamline tractography algorithms show the best performances in predicting which areas are connected. Altogether, we propose a method for quantitative evaluation of tractography algorithms, which aims at improving the sensitivity and the specificity of diffusion-based connectivity analysis. Overall, those results confirm the usefulness of tractography in predicting connectivity, although errors are produced. Many of the errors result from bottleneck white matter configurations near the cortical grey matter and should be the target of future implementation of methods

Prediction of Early Symptom Remission in Two Independent Samples of First-Episode Psychosis Patients Using Machine Learning

BACKGROUND: Validated clinical prediction models of short-term remission in psychosis are lacking. Our aim was to develop a clinical prediction model aimed at predicting 4−6-week remission following a first episode of psychosis. METHOD: Baseline clinical data from the Athens First Episode Research Study was used to develop a Support Vector Machine prediction model of 4-week symptom remission in first-episode psychosis patients using repeated nested cross-validation. This model was further tested to predict 6-week remission in a sample of two independent, consecutive Danish first-episode cohorts. RESULTS: Of the 179 participants in Athens, 120 were male with an average age of 25.8 years and average duration of untreated psychosis of 32.8 weeks. 62.9% were antipsychotic-naïve. Fifty-seven percent attained remission after 4 weeks. In the Danish cohort, 31% attained remission. Eleven clinical scale items were selected in the Athens 4-week remission cohort. These included the Duration of Untreated Psychosis, Personal and Social Performance Scale, Global Assessment of Functioning and eight items from the Positive and Negative Syndrome Scale. This model significantly predicted 4-week remission status (area under the receiver operator characteristic curve (ROC-AUC) = 71.45, P < .0001). It also predicted 6-week remission status in the Danish cohort (ROC-AUC = 67.74, P < .0001), demonstrating reliability. CONCLUSIONS: Using items from common and validated clinical scales, our model significantly predicted early remission in patients with first-episode psychosis. Although replicated in an independent cohort, forward testing between machine learning models and clinicians’ assessment should be undertaken to evaluate the possible utility as a routine clinical tool

Prediction of Early Symptom Remission in Two Independent Samples of First-Episode Psychosis Patients Using Machine Learning

Background: Validated clinical prediction models of short-term remission in psychosis are lacking. Our aim was to develop a clinical prediction model aimed at predicting 4-6-week remission following a first episode of psychosis.Method: Baseline clinical data from the Athens First Episode Research Study was used to develop a Support Vector Machine prediction model of 4-week symptom remission in first-episode psychosis patients using repeated nested cross-validation. This model was further tested to predict 6-week remission in a sample of two independent, consecutive Danish first-episode cohorts.Results: Of the 179 participants in Athens, 120 were male with an average age of 25.8 years and average duration of untreated psychosis of 32.8 weeks. 62.9% were antipsychotic-naive. Fifty-seven percent attained remission after 4 weeks. In the Danish cohort, 31% attained remission. Eleven clinical scale items were selected in the Athens 4-week remission cohort. These included the Duration of Untreated Psychosis, Personal and Social Performance Scale, Global Assessment of Functioning and eight items from the Positive and Negative Syndrome Scale. This model significantly predicted 4-week remission status (area under the receiver operator characteristic curve (ROC-AUC) = 71.45, P &lt;.0001). It also predicted 6-week remission status in the Danish cohort (ROC-AUC = 67.74, P &lt;.0001), demonstrating reliability.Conclusions: Using items from common and validated clinical scales, our model significantly predicted early remission in patients with firstepisode psychosis. Although replicated in an independent cohort, forward testing between machine learning models and clinicians’ assessment should be undertaken to evaluate the possible utility as a routine clinical tool